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ABSTRACT 



The design of controllers to provide quasi-minimum 
time-response is investigated. With the control law to be 
realized as a piecewise-linear combination of the instan- 
taneous state values, the problem is to select the para- 
meters which define the best suboptimal switching surface. 

A worst-case response-time performance index is de- 
fined and shown to be suitable for use in the suboptimal 
controller design. A proposed design technique is describ 
ed and used to determine controllers for second-order sys- 
tems. The results of the illustrative examples are compar 
ed with controllers designed using a least squares polyno- 
mial fitting technique. The comparison shows that the 
proposed method designs significantly better controllers 
in terms of deviation from optimal response time. 



DUDLEY KNOX LIBRARY 
NAVAL POSTGRADUATE SCHOOL 
MONTEREY CA 93943-5101 

TABLE OF CONTENTS 

Page 

1 t INTRODUCTION 7 

2. THE PIECEWISE -LINEAR SWITCHING FUNCTION n 

2.1 The Optimal Switching Surface 11 

2.2 The Piecewise-Linear Switching 

Surface 14 

2.3 Effects of PWL Switching 17 

3. SELECTION OF AN INDEX OF PERFORMANCE 21 

3.1 General Comments 21 

3.2 Response-Time Summation Indices 22 

3.3 Non-response-Time Indices 28 

3.4 Worst-Case Response-Time Indices 31 

4. DESIGN OF THE PWL SWITCHING SURFACE 35 

4.1 Steps of the Design Procedure 35 

4.2 Selection of the Initial Conditions 

and Their Range 37 

4.3 Selection of the Number of PWL 

Segments 39 

4.4 Searching the Cost Surface 40 

5. DESIGN OF SECOND-ORDER CONTROLLERS 43 

2 

5.1 Double Integrator, 1/s , Design Example 43 

5.2 l/s(s+a) Design Example 48 

5.3 Comparison of Design Methods 52 

6. SUMMARY 55 

6.1 Discussion of Results 55 

6.2 Areas for Further Study 56 



3 



Page 



BIBLIOGRAPHY 




58 


APPENDIX 


A: 


Pattern Search for Cost Index 








Minimization 


59 


APPENDIX 


B: 


Computer Programs 


63 



4 



LIST OF ILLUSTRATIONS 

Figure Page 

1. Optimal Controller 8 

2. Minimum-Time Trajectories 13 

3. Composite Minimum-Time Trajectories 14 

4. The PWL Switching Surface 16 

5. Effects of PWL Switching 17 

6. Multiple-Segment PWL Switching 19 

7. One-Segment PWL Switching 23 

8. Cost Surfaces for Summation Indices 25 

9. Cost Surfaces for 4 and 10 Initial 

Conditions 27 

ID. Transverse Trajectory Time 30 

11. Cost Surfaces for Worst-Case Indices 33 

12. Additive Constant in the Response Time 38 

13. One-Segment Controller 44 

14. Optimal and Best One-Segment PWL Surfaces 45 

15. Two-Segment PWL Controller 45 

16. Optimal and Best Two-Segment PWL Surfaces 46 

17. Three-Segment PWL Controller 47 

18. l/s(s+a) One-Segment PWL Controller 50 

19. Optimal Switching Surface for l/s(s+a) 50 

20. Comparison of Switching Surfaces 53 

21. Comparison of Controller Designs 54 



5 



1. INTRODUCTION 



This thesis presents a proposed method for the design 
of controllers that provide qua si -minimum- time response of 
systems described by the set of state equations 

(1.1) x(t) = Ax ( t) + Bu ( t) 

where 

x is an nxl state vector 

A is the nxn plant matrix 

u is the bounded scalar control 

13 is the nxl distribution matrix of the control. 

In order to insure that an optimal control exists, the 
plant transfer function is restricted to one having only 
real, negative eigenvalues, and it is further specified 
that it have no zeros. Additionally, all states must be 
observable and the control effort bounded. 

For plants of the type described, previous studies 
[l, 3] have shown that a unique optimal control will exist 
that transfers the plant from any point in the state space 
to the origin with no more than n-1 switches of the control. 
Furthermore, the control will always be at its maximum pos- 
itive or negative value (i.e. the bang-bang control) . 

Since the control is always at its maximum value, an ideal 
relay can be used to provide the control to the plant if 
some other device can be constructed to properly control 
the relay as shown in figure 1. 
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Plant Controller 




Figure 1. Optimal Controller 

From the figure it is seen that 

(1.2) u = sgn a 

Therefore, the controller must generate the proper a to 
transfer the plant from x(0) , the initial condition vec- 
tor, to x(f ) , the desired final condition vector, in mini- 
mum time. When the plant input, r, is zero the problem 
becomes that of the linear regulator since the desired 
state of the system at the final time is the state space 
origin. If r is non-zero but restricted to an allowable 
class of input functions, the effect may be described as 
a shift in the state origin. 

Time-optimal control can be implemented for the sys- 
tems considered in this study by one of two general meth- 
ods. In the first method, a digital computer is used as 
the controller. The computer must rapidly calculate the 
control using the differential equations of the plant and 
the specific initial condition. The disadvantages of this 
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method are that it is open-loop which is undesirable since 
unexpected disturbances are not taken into account, and it 
is possible that the computer may not be able to generate 
the solution rapidly enough to allow proper switching of 
the control. The second method of generating the optimal 
control is to determine 0 as a function of the state vari- 
ables of the plant with some electronic device. While 
more appealing than the first method, this method is lim- 
ited in application by the fact that a closed form ex- 
pression for the switching function is not usually obtain- 
able for systems of higher than second order. 

In many instances the complexity and cost of the op- 
timal controllers described above is not justified from an 
engineering point of view. That is, a less complex and 
more easily implemented controller may be acceptable if it 
can be designed to deviate from optimal performance by 
only a "small” amount. The problem then becomes that of 
developing a design procedure which results in an easily 
realized controller that produces acceptable, suboptimal 
response of the plant. 

In this investigation a suboptimal design method is 
developed using a controller of a pre-specif ied form. The 
parameters of the controller are adjusted to provide ac- 
ceptable time response of the plant. In the state space 

★ 

the optimal switching function, 0 , consists of a hyper- 
surface that divides the space into regions of +M and -M 
control, where | M I is the absolute magnitude of the bound- 
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ed control. Throughout the remainder of this study it 
will be assumed that all equations are normalized so that 
I M | =1. It would seem that the switching function gen- 

erated by the suboptimal controller should be a hypersur- 
face that lies "close" to that generated by the optimal 
controller. 

The suboptimal switching function used in this work is 
a piecewise-linear combination of the state variables of 
the system. 

In Section 2 the optimal and suboptimal switching sur- 
faces are described. Selection of an index of performance 
is the topic in Section 3. An outline of a proposed design 
procedure for suboptimal controllers is presented in Sec- 
tion 4 and Section 5 gives the results of suboptimal con- 
troller designs using the proposed procedure and compares 
the designs with controllers designed by another method. 
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2 . 



THE PIECEWISE -LINEAR SWITCHING FUNCTION 



2 . 1 The Optimal Switching Surface 

For time-optimal control the switching function di- 
vides the state space into areas of -1 control. The 
closed form of the optimal switching function as a func- 
tion of the system state variables can be expressed as 

(2.1) a* = f*(x) = 0 

Alternatively, this function can be expressed as 

(2.2) cr = f (x‘ ) - x^ = 0 

where 

* indicates optimal 

x' is the previous x vector with the x^ component 
removed 

if the function is single valued in x^. The function 

• k 

f (x 1 ) is independent of x^ and gives the x^ coordinate of 
the optimal switching surface. For plants of the form pre 
scribed for this study, Smith [2] has shown that the sur- 
face can be made single valued in the uncoupled state vari 
ables by transforming to Jordan canonical form. In many 
instances, however, the optimal switching surface is al- 
ready single valued in at least one state variable so that 
no transformation is necessary. 

Since n-1 switches of the control are required to 
transfer the system from any initial point to the state 
space origin in minimum time, the optimal switching sur- 
face may be generated by integrating the state equations 
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backwards in time and switching the control n-2 times. 
This procedure generates one half of the optimal surface. 
The other half is easily obtained since the surface is an 
odd function of the state variables for a linear system 
with symmetrical control. 

The optimal switching surface and trajectories for a 
second order, double integrator plant may be obtained by 
solving the differential equations of the plant, 

x 1 (t) = x 2 (t) 

(2.3) 

X 2(t) = u 

where 

u = +1 . 



Using classical methods to solve these equations with a 
given set of initial conditions x(t Q ) yields 
for u = -1 

x 1 (t f ) = x 1 (t Q ) + tx 2 (t o ) - ±t 

(2.4a) 



x 2 (t f- ) -fi: ^2 (t o ) ■" 

for u = -flp.ji.iUc! ninoj v/c ir* 4 \i c > . 

X x (t f ) = x 1 (t o ) + tx 2 (t o ) t 

(2.4b) 



F-; 



J l .« < • l 



X 2 ^f ^ = x 2 + tm 

The minimum-time trajectories in the state space may be 
obtained by eliminating the variable t and solving for 
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x-^(t) in terms of x 2 (t) which results in the well known 
families of parabolas 

x l(t) = -j X 2 (t) + Cl for u = -1 

(2.5) 

x l(t) = •j x 2 (t) + C 2 for u = +1 
The families are shown in figure 2. 





Figure 2. Minimum-Time Trajectories 
To force the states of the system from a set of random ini- 
tial conditions in the state space to the origin in mini- 
mum time, the families shown above must, generally, be 
combined to produce the minimum-time trajectories as shown 
by Pontryagin [ 1 ] - Four typical trajectories are shown in 
figure 3. 
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Figure 3. Composite Minimum-Time Trajectories 



From point (a) the minimum-time control sequence is u = -1 
followed by a switching to u = +1 when the trajectory in- 
tersects the u = +1 parabola that passes through the ori- 
gin. For point (b) the opposite sequence must be follow- 
ed. Since points (c) and (d) are on the parabolas that 
pass through the origin, no switches of control are re- 
quired. (c) and (d) can reach the origin with n-2 switches 
of control, therefore they lie on the optimal switching 
surface, in this case a line, which from equation ( 2 .4) is 



2 . 2 The Piecewise-Li near Switching Surface 

Since the suboptimal switching function specified in 
this study is a piecewise-linear function of the state var- 
iables of the system it can be expressed as 



(2.6) x 1 = - | x 2 | x 2 | 



(2.7) 8 - f(x') 
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where 



A indicates suboptimal 

For the second-order systems considered in this investiga- 
tion the switching surface reduces to a line in the state 
space and is given by 

(2.8) x 2 = [P(l)/P(2) ]x 1 l(x 1 )+[-P(l)/P(2)x 1 +P(l) ] 

L 

H(x 1 -P(2) + ^{A(i)x 1 H[x 1 -P(2i-2) ] 
i=2 

+[-A (i) x^+P (2i-l) ] UCx 1 -P (2i) ]} 

V 

where 

A (i) = [p(2i-l) -P(2i-3) ]/[p(2i) -P(2i-2) ] 

H(arg) = 1 (arg) ^ 0 

= 0 otherwise 

L = number of PWL segments 

P(odd) = x 2 coordinates of breakpoints in the PWL sur- 
face 

P(even) = x^ coordinates of breakpoints in the PWL 
surface . 
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Figure 4. The PWL Switching Surface 
For the purposes of this paper it will be assumed 
that the range of initial conditions is known. P(2L) will 
be determined by this expected range. The design proce- 
dure must determine the best, in some sense, values for 
the other 2L-1 parameters of the surface. The number of 
segments, L, in the pwl surface is not prespecified in 
this design procedure since it is desired to complete the 
controller using the minimum number of segments. 

The implementation of the pwl switching surface is 
easily accomplished using resistors, diodes and batteries. 
Redderson [4] has shown construction of pwl function gen- 
erators using these elements. The objective of this inves- 
tigation is the development of a method for selecting the 
best parameters describing the pwl surface. The remainder 
of this study will deal with the design method develop- 
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ment -- not the physical construction of the controller. 
2 . 3 Effects of PWL Switching 



As described previously, a, maximum of n-1 switches of 
control are necessary for minimum-time control. Since this 
study deals with suboptimal control, it is of interest to 
investigate the trajectories and switchings caused by the 
suboptimal switching surface. Consider the one segment 



pwl switching surface shown in figure 5. 




Figure 5. Effects of PWL Switching 

For the case of one segment, the pwl switching pro- 
blem reduces to the linear switching problem using tachom- 
eter feedback for a relay controller as described by 
Gibson [ 5 ] and others. In figure 5 the trajectory that 
intersects the pwl surface at point (a) will be switched 
optimally and will reach the origin in minimum time. All 
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other trajectories shown will deviate from the optimal and 
will, therefore, be suboptimal. The trajectory intersect- 
ing the pwl surface at point (b) will follow a u = +1 tra- 
jectory until reaching (c) at which time it will chatter 
or bump down toward the origin. Any trajectory intersect- 
ing between point (d) , the point of tangency with an opti- 
mal trajectory, and the origin will immediately begin to 
chatter and will continue to do so until reaching the ori- 
gin. Finally, a trajectory intersecting the pwl surface 
below the optimal surface, such as at point (e) , will move 
around the origin until it again intersects the pwl sur- 
face and will then bump to the origin. Due to the nature 
of relay chatter the states of the system can never exact- 
ly reach the origin when bumping occurs in the final stage 
of a trajectory. A system will be considered to have 
reached the origin when the states enter and remain within 
a circular neighborhood or radius r. 

For a multiple-segment pwl surface the effects noted 
above all occur, but the problem is compounded since they 
may occur on each segment. A two-segment pwl switching 
surface is shown in figure 6. 
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Figure 6. Multiple -Segment PWL Switching 

From point (a) a trajectory will move around the origin 
until intersecting the pwl surface at (d) and then bump to 

V 

the origin. From point (f) a trajectory will follow a 
u = +1 parabola to (g) , bump to (c) , move around the ori- 
gin to (e) and then bump down. The trajectory intersect- 
ing at (b) will bump to (c) and then follow the sequence 
described above to the origin. 

Redderson [4] gives the time it takes a second-order 
system to bump from x ^(t Q ) to x^(t^) along a pwl segment 
as 

i i-a+bx. 

(2.9) t„ = £ L°9 U + bx'(t )J 

1 ' o 

where 

b = slope of the pwl segment 
a = X£ intercept of the segment. 

To achieve good suboptima 1 performance this bump time must 
be minimized since it represents the major deviation from 
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optimal performance. Bumping must also be minimized be- 
cause frequently repeated rapid changes of control are not 
desirable in physical systems due to the component wear 
produced. 
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3. SELECTION OF AN INDEX OF PERFORMANCE 



3 . 1 General Comments 

In order to evaluate any design method for the pro- 
posed suboptimal controller, an index of performance, or 
cost index, must be specified. The index should indicate 
how much the suboptimal controller causes the system to 
deviate from optimal performance. Since quasi-optimal con- 
trol is desired, the optimal and suboptimal responses 
should deviate by only a small amount. The cost index se- 
lected should indicate close to optimal performance by 
having a small value which should increase as optimal and 

V 

suboptimal control deviate to a greater extent. For time- 
optimal control the cost index is defined as 



(3.1) 




- t 

o 



Minimizing the above index leads to the time -optimal switch- 
ing surface discussed in section 2.1. 

The selected cost index should generate a smooth cost 
surface to allow easy location of the minimum. Three dif- 
ferent types of cost indices may be defined for use in the 
suboptimal problem as described in this paper. The three 
types are 

a) response-time summation indices 

b) non-response-time indices 

c) worst-case indices 

These three types of indices will be discussed in the re- 
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mainder of this section. 

3 . 2 Response-Time Summation Indices 

Since the problem being studied is that of qua@i-min= 
imum-time control, a cost index that evaluates the design 
on the basis of the actual plant response times under pwl 
switching seems desirable. Many indices of this type may 
be defined. Some examples are given below. 



K 



(3.2) 1) J, = 



i y g 

K L i 
i~l 
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2) J 2 s K I 
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where K = number of initial conditions 

A , f|j 

t , - pwl response txme lui i initial 
cond i I. i on 
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* ' 

= optimal response time for i 

initial condition 

The indices defined above are summations of various 

measures of system response time and include effects from 

all initial conditions in the evaluation. A desirable 

feature for an index would be that it equally weight all 

initial conditions regardless of their location in the 

state space. Of the indices given above and give 

more weight to initial conditions further from the origin. 

The other indices give equal weight to all initial condi- 

* 

tions since a normalizing factor, 1/t , is used. It then 
appears that this normalizing factor should be used in 
the index finally selected for this study. 

The indices defined above all possess a major limita- 
tion which appears only after a detailed study of the cost 
surfaces that they generate. 




Figure 7. One-Segment PWL Switching 
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Figure 8. Cost Surfaces for Sununation Indices 



Figure 7 suggests that if the parameter values are adjusted 
so that the trajectory for a particular initial condition 
such as (c) is switched at the optimal surface, it will be 
truly optimal and the summation indices will generate a 
local minimum in the cost surface at this parameter set- 
ting. As the parameter P(l) is varied the other initial 
conditions will follow optimal trajectories for certain 
settings as described above and will cause additional lo- 
cal minima. The number of local minima in the cost sur- 
face increases with an increase in the number of initial 
conditions, however, the depth of each is less since each 
component in the summation has a smaller effect upon the 
total . 

Figure 8 shows the cost surfaces generated by the six 
summation indices for four initial conditions as P(l) is 
varied from -4 to -8. The figure shows that four initial 
conditions may produce more than four local minima. The 
effect upon the cost surface of increasing the number of 
initial conditions is shown in figure 9 for as K is in- 
creased from four to ten. It is seen that the surface is 
smoothed considerably by the increase but that the number 
of local minima is also increased. The irregularity of 
the cost surface is the problem that limits the use of the 
summation indices. Normal search techniques are not able 
to locate the global minimum but will stop when a local 
minimum is reached. With the possibility of the search 
terminating upon reaching a local minimum the parameters 
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Figure 9. Cost Surfaces for 4 and 10 Initial Conditions 



of the pwl surface selected may not be the best attainable 
and the designer will not be sure when the best design has 
been completed. Frederick [6] has improved the shape of 
the cost surface generated by a summation index by limit- 
ing the number of pwl surface parameters to a number which 
allows it to be easily searched.. Limitation of the number 
of pwl, parameters in this fashion is felt to reduce the 
ability of, any, design, procedure to arrive at the best sub- 
optimal controller. 

3.. 3 Non-response-Time Indices 

) , \ ft ‘ ’ ' 

In view of the irregular s^ape and attendant search- 
ing difficulties of the cost surfaces generated by the 
summation indices discussed above, another measure of sys- 
tern performance must be defined if a controller design 
method is to be developed. Smith [2] has used the well- 
known least squares curve fitting technique to fit the pwl 
surface to the optimal surface for a specified set of break- 
points in the pwl surface. The index for this method may 
be defined as 

P 

(3.3) J * I(x ±j - x ij) 

J=1 

where 

* 

x^j = points describing the optimal surface in the 
independent variable, x^ 

x i ^ = points on the pwl surface in the independent 

if 

variable corresponding to Xj . 
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P = number of points over which the pwl surface is 
fitted. 

The object of Smith's design method is to minimize this in- 
dex which represents the sum of the squared distances be- 
tween points on pwl and optimal surfaces measured in the 
coordinate direction of the independent state variable. 

Using the analytic least squares technique the desired 
minimization is easily accomplished. For one pwl segment 
with one variable parameter this index generates a smooth 
parabolic cost surface which is easily searched. 

While simple in concept and implementation, the above 
method suffers from the fact that it does not guarantee 
good time response of the plant. It only assures that 
the pwl surface will lie close to the optimal surface. 

Actual system response time is never considered in the de- 
sign of the switching surface. After the design is com- 
pleted it may be partially justified by using the control- 
ler with the plant for a set of representative initial con- 
ditions and observing the performance. This is an after 
the fact type of evaluation and the design must be complete- 
ly redone if the performance is not acceptable. Also, as 
stated above, the breakpoints of Smith's pwl surface, the 
P(even) in the notation of this paper, are specified prior 
to the least squares minimization. This allows optimiza- 
tion of only one half of the available pwl parameters. It 
should be observed that if the design is found to be un- 
acceptable it can be repeated with another set of break- 
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points. The problem with this procedure is that previous 
trials provide little information of value in selecting 
the breakpoints for future trials. 

Redderson [4] also used least squares fitting tech- 
niques but defined his cost index as 

• • . p 

(3.4) J = l (6 2 ) 

i=l 1 

where 6 is defined as the transverse trajectory time be- 
tween the pwl and optimal surfaces as shown in figure 10. 




Figure 10. Transverse Trajectory Time 



Minimizing this index relates the pwl fitting to system 
response time, but it is not really a measure of overall 
performance. Since it measures trajectory time between 
the surfaces it again, as does Smith's index, only assures 
that they will be close together. Actual system perform- 
ance must be evaluated upon completion of the design using 
representative initial conditions. The advantage of this 
method over Smith's is that the breakpoints of the pwl sur- 
face, as well as the slopes, are allowed to vary which re- 
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suits in optimizing over all of the parameters. This 
should result in a better least squares fit and, if indeed 
there is a relationship between the goodness of fit and 
response time, better system performance. Since there is 
no definite relationship between these quantities addi- 
tional response -time indices should be considered in an 
effort to provide better suboptimal response. 



3.4 Worst-Case Response-Time Indices 

The difficulties of local minima with the summation 
indices and of no real relationship between good least 
squares fit and good system response can be avoided by 
selecting an index that measures the worst deviation from 
optimal performance for the set of initial conditions. 
Three examples of this type of index are given below. 



(3.5) 


J 1 


= max 
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t . /t . 

1 ' 1 


(3.6) 
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= max 

mi 


A 
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(3.7) 


J 3 


= max 

mi 


A 

( t . " t . 
V 1 1 



where 



A 

t. 

1 



th 

= pwl response time for 1 initial condition 
= optimal response time for i*"* 1 initial condition 



x (0) = initial condition vector. 



The cost surface is generated by minimizing the indices 
with respect to the pwl parameters. The design can then be 
described as the min-max problem which has been studied by 
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von Neumann [7] and others. 

* 

(3.8) J = min max J 

P x (0) 

where 

p is the vector of pwl parameters. 

As noted by Kalman [8] the minimum-time problem can be re- 
garded as a two-player zero-sum min-max game. That is, 
nature tries to maximize response time while man tries to 
minimize it. 

Since it is desired that the index selected indicate 
desired performance and generate a smooth cost surface, 
the three indices were evaluated for the second-order one 
pwl segment case. Figure 11 shows the surfaces as P(l) 
varies from -7.45 to -50.7 with P(2) set at +16. and 

show smooth behavior over the range of the variable 
parameter. is also generally smooth but does show 

minor irregularities. The points plotted are the costs 
for a set of 24 initial conditions spaced along the x^ co- 
ordinate axis. 

* 

If the min-max point, J as given by equation (3.8), 
can be found the designer is assured that system perform- 
ance for all the initial conditions can be no worse than 

* 

that indicated by J . The system performance for other 
initial conditions wibhin the design range will be dis- 
cussed in sections 4 and 5. Figure 11 shows that all 
three indices generate easily searched cost surfaces. For 
the design method to be presented in the next section the 
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Angle with Horizontal 

Figure 11. Cost Surfaces for Worst-Case Indices 



index 



(3.7) J = max 

xiQl 



( 




i 



■) 



was chosen. This index measures the worst deviation be- 
tween pwl and optimal performance. It also includes the 

* 

normalizing factor 1/t to insure that all initial condi- 
tions are equally weighted while looking for the one with 
maximum deviation. As an example of the necessity for 
this weighting, consider a deviation time of 2 seconds. 

If the optimal response time were 15 seconds this devia- 
tion would probably be acceptable. 



However, with an optimal response time of one second, the 



J = -r±- = .1333 



normalization clearly shows that this performance is poor. 



J = j = 2.0 
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4 r DESIGN OF THE PWL SWITCHING SURFACE 
4 . 1 Steps of the Design Procedure 

In order to obtain acceptable performance from the pwl 
controller it is necessary to determine the parameters that 
minimize the cost index selected in the last section. The 
steps of the procedure to obtain these parameter values 
are listed below. 

a. Select the region in the state space for which 
the design is desired and a set of initial condi- 
tions representative of this region. 

b. Obtain the optimal response times for the select- 
ed initial conditions. 

c. Select an initial set of parameters to define a 
one segment pwl switching surface. 

d. Evaluate the cost index to determine if perform- 
ance of the controller is acceptable. If it is 
acceptable the design is complete. 

e. If performance is not acceptable, vary the para- 
meters in some systematic manner to improve per- 
formance. 

f. Repeat steps (d) and (e) until performance is 
acceptable or no further improvement is possible. 

g. When no further improvement is possible and per- 
formance is still unacceptable, increase the num- 
ber of pwl segments by one by defining a new set 
of initial parameters. 

h. Repeat steps (d) through (g) until acceptable per- 
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formance results or no further improvement is 
possible . 

Thus far, it has been stated that the design process 
is completed when a set of pwl parameters is found that 
produce "acceptable" performance of the plant. At this 
point it is necessary to define this acceptability crite- 
rion. The procedure outlined above, when used with the 
cost index selected in the last section, results in mini- 
mizing the normalized or percentage deviation time for the 
set of initial conditions. By defining the acceptability 
criterion as some percentage deviation from optimal re- 
sponse time. 

At A * 

(4.1) J a = — At a = (t-t ) acceptable 

the procedure assures that the system will respond at least 
this well, and for most initial conditions it will be bet- 
ter. It also completes the design using the minimum number 
of pwl segments and upon completion of each cycle indicates 
the improvement gained by the addition of the last segment. 

The value selected for J g is a function of many var- 
iables. The system being controlled, its employment, allow- 
able cost and complexity of the controller are all factors 
that must enter into selection of the acceptability crite- 
rion. The designer must determine how close to the optim- 
al he desires the pwl controller to operate in view of the 
above factors. After the pwl parameters are selected by 
the design procedure, the controller must be implemented 
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using pwl function generators to produce the control as a 
combination of the state variables as described in section 

2 . 

4.2 Selection of the Initial Conditions and Their Range 

While it would be desirable for the pwl controller to 
provide acceptable control for initial conditions through- 
out the entire state space, the proposed design method min- 
imizes the cost index for the set of selected conditions. 
From an engineering standpoint this is not a serious , re- 
striction since for most physical systems a range of ex- 
pected initial conditions can usually be predicted. The 
( controller must, then, provide acceptable control over 
this range and not the entire state space. Consider a 
shipboard missile launcher as an example. Under normal 
conditions this system would be at some initial position 
with no velocity or acceleration. Assume that the system 
is modeled as a third order system with the states defined 
as 

x^ = angle of launcher with respect to some re- 
ference 

x 2 = angular velocity 
x 3 = angular acceleration. 

In the three dimensional state space the possible initial 
conditions would be located along the x^ coordinate axis. 
The range of the initial conditions is also limited in this 
example by the maximum train angle of the launcher which is 
usually restricted to somewhat less than 2 it radians by such 
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things as electrical cable twist and structural interfer- 



ence. 



It can be shown that initial conditions lying along 
the pwl surface generally respond more poorly than those 
located in other regions of the state space. In view of 
the engineering considerations mentioned above and the 
fact that placing the initial conditions along the pwl sur- 
face requires recomputation of optimal response times after 
each parameter perturbation, it was decided to place them 
along the positive axis for the second order examples 
presented in the next section. This corresponds to a sys- 
tem with initial position but no initial velocity. After 
the set of initial conditions is selected for which the con- 
troller is to be designed, the optimal response times neces- 
sary for normalization can be generated once and need not 
be recomputed after each change in parameter settings. 
Selecting the initial conditions in this manner introduces 
an additive constant into the response times, because each 
trajectory moves across the state space in an optimal man- 
ner until it reaches the pwl or optimal switching surface 
at which time it begins to deviate from optimal response. 



x 



2 




Figure 12. Additive Constant in the Response Time. 
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Figure 12 shows the additive constant that results from 
the trajectories crossing the state space before starting 
to deviate. Notice that the normalized deviation time 
index used in this design procedure removes this constant 
since it measures only the deviation from optimal response. 
If a summation of response times index had been selected 
this constant could affect the optimization process since 
it might reduce the differences between various controllers 
so that the best design was not readily apparent. 

Since the minimization of the cost index is performed 
over a finite set of initial conditions, it is necessary, 
upon completion of the design, to evaluate the system res- 
ponse for other initial conditions in the range of interest. 
This check is required to insure that there are no points 
in the range that result in unacceptable performance. The 
smooth shape of the cost surface should insure that once 
the best parameter settings are found for a large enough 
set of initial conditions, all others in the range will 
respond acceptably also. 

4. 3 Selection of the Number of PWL Segments 

In the design of the pwl controller, it is desirable 
to generate the control using the minimum number of pwl 
segments. This produces both the least complex and least 
costly solution to the problem while still providing ac- 
ceptable performance. The design method outlined in section 
4.1 has this desirable feature. If the performance with L 
segments is acceptable, the design is completed and there 
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is no need to evaluate L+l segments. Smith [2] starts his 
design by specifying the number of pwl segments to be used 
and then attempting to provide good performance by adjust- 
ing the segment slopes. Redderson ' s [ 4 ] method is similar 
in that the number of segments is prespecified, but both 
slopes and lengths of the segments are allowed to vary. 

If an adceptability criterion that allows appreciable 
deviation from optimal performance is selected, linear 
switching may be adequate. Since the proposed design meth- 
od st&rts with one segment, it will be evident if this is 
true. If a specified number of segments is determined to 
provide unacceptable control, only one more segment is 
added and the design is terminated when acceptability is 
reached. Therefore, use of the minimum number of segments 
is insured. 

Additionally, it is possible to monitor the approach 
to acceptability by comparing the best cost obtained be- 
fore and after adding a segment. If the improvement is 
small, the acceptability criterion should be reviewed to 
determine if it is too strict before adding additional seg- 
ments which increase cost and complexity. At all stages 
in the design procedure it is well to monitor the effect 
of adding a segment to insure that the design is completed 
using the minimum number of segments. 

4.4 Searching the Cost Surface 

With the cost index, the set of initial conditions 
and the initial pwl segments selected, once the method of 
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searching the cost surface is described the design method 
is complete. For a second-order pwl switching surface of 
L segments the cost surface is a function of 2L-1 varia- 
bles. This 2L-1 dimensional space must be searched to de- 
termine the best parameter settings for the controller. 

In view of the high dimensionality of the cost surface, an 
efficient search technique must be used to minimize the 
computer time required for the design process. 

Hooke and Jeeves [9] have developed a direct search 
technique and shown that computation time increases roughly 
as the first power of the number of variables not as the 
cube as is the case for most classical minimization tech- 
niques. This direct or pattern search makes use of past 
successful parameter adjustments to predict possible good 
future moves. The search establishes a pattern of impro- 
vement based upon the success of individual parameter per- 
turbations. The size of the pattern grows with continued 
success, thus accelerating the search toward the minimum. 
If a move does not result in improvement, the size of the 
perturbation is reduced until improvement results or a 
limiting criterion is reached and the search is terminated. 
A more detailed description of the pattern search may be 
found in Appendix A. 

The pattern search was chosen for the minimization of 
the cost index in this study because of its relative sim- 
plicity and efficiency. It is noted that this search is 
dependent upon the perturbation step size and the initial 
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parameter settings. More efficient search methods could 
probably be developed to accomplish the minimization but 
it is felt that the pattern search is sufficient for this 
study. The next section will present two examples of this 
method used to design controllers for second order systems. 
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5. DESIGN OF SECOND-ORDER PWL CONTROLLERS 



The real test of any design method for pwl switching 
surfaces is the actual performance of various systems when 
operating with the pwl controller. This section presents 
two examples of controller design for second-order systems. 
Controllers were designed for 1/s and l/s(s+a) plants. 

The systems were digitally modeled using finite state dif- 
ference equations for simulation on an IBM 360/67 high 
speed, general purpose digital computer. The results of 
the designs are presented, and a comparison with control- 
lers designed using Smith's [2] least squares method is 
made. 

2 

5 . 1 Double Integrator, 1/s , Design Example 

2 

The double integrator, 1/s , plant was chosen as the 
first example to test the feasibility of the worst-case 
cost index. The initial conditions were spaced along the 
positive x^ axis as described in section 4.2. The optimal 
response times for the set of initial conditions w' re ob- 
tained using the minimum-time isochrones for the plant. 1 

= x 2 (t o )+ ^x 1 (t o )+2x 2 2 (t Q ) x 1 > - -|x 2 | x 2 | 
(5.1) = I x 2 | x i = - -jx 2 | x 2 | 

= -x 2 (t o ) +J-A^ (t o )+2x 2 2 (t Q ) x x < - -|x 2 | x 2 | 



^ See Athans and Fa lb [3], p 714. 



For the digital simulation of the system the discrete dif- 
ference equations for the plant were used. 

(5.2) x^K+Dt] = x^KTH T x 2 (KT)+ j T 2 u (KT) 
x 2 [(K+1)t] = x 2 (KT)+ T u (KT) 

These difference equations were used to reduce the comput- 
er time required to generate the suboptimal response times 
which are necessary when evaluating the success of each ex- 
ploratory and pattern move in the pattern search. Initial- 
ly, fourth-order, double precision Runga-Kutta integration 
was used, but computer time was excessive. Using the dif- 
ference equation method computer time was approximately 
halved. Although the difference equation solution of the 
plant differential equations is less precise than the 
Runga-Kutta integration, no loss of accuracy was observed 
when points describing several trajectories were compared. 

Rather than arbitrarily specifying an acceptability 
criterion, it was decided to allow the procedure to design 
the best possible controller for this first example. The 
fixed parameter and the variable parameter defining a one- 
segment controller were selected and the design procedure 
accomplished. The results of this design are presented in 
figure 13. 





Initial 


Final 


Cost 


26.09 


.8433 


P(l) 


-1.0 


-9.41 


P(2) 


10.0 


10.0 



Figure 13. One-Segment Controller 
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A comparison of the pwl and optimal switching surfaces is 




Figure 14. Optimal and Best One-Segment PWL Surfaces 

The final cost listed in table I indicates that the one- 
segment controller causes appreciable deviation from op- 
timal response. 

In order to improve the suboptimal performance, a 
second pwl segment was added to the controller as called 
for by the design method and the increased set of parame- 
ters optimized. The results are presented in figure 15. 





Initial 


Final 


Cost 


.8227 


.0907 


p(l) 


-1.0 


-.9812 


P(2) 


1.0 


.4187 


P ( 3 ) 


-7.0 


-4.572 


P (4) 


10.0 


10.0 



Figure 15. Two-Segment PWL Controller 
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The two-segment pwl switching surface is shown with its 




Figure 16. Optimal and Best Two-Segment PWL 

Surfaces 

* <. 

The final cost of the two-segment design given in figure 
15 shows that the worst percentage deviation from optimal? 
response is approximately nine percent. I,f an.< acceptabil- 
ity criterion of more than this value had been^ selected 
the pwl controller design would now be complete. 

In order to determine if better pwl performance was 
attainable, a third segment was added to the pwl switching 
surface. The parameters were optimized and the results 
are presented in figure 17. 
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Initial 


Final 


Cost 


.2588 


.0511 


P(l) 


-1.305 


-.9456 


P(2) 


.744 


.3868 


P (3) 


-2.7 


-2.974 


P (4 ) 


5.0 


4.4 


P(5) 


-5.0 


-5.4 


P(6) 


16.0 


16.0 



Figure 17. Three-Segment PWL Controller. 

The addition of the third segment to the switching surface 
decreased the cost by only .0396 while the two-segment 
case reduced it by .7526 over the one-segment case. 

Unless extremely close to optimal control is desired, the 
complexity added to the system by the third segment may 
not be justified. 

This example has shown that a pwl controller can be 
designed for the 1/s plant that results in no more than 
5.11 percent deviation from optimal response time for the 
set of selected initial conditions. As mentioned in sec- 
tion 4.2, a check must be made using other sets of initial 
conditions to insure that the design is acceptable over 
the entire range. The two-segment controller of figure 15 
was evaluated with two additional sets of initial condi- 
tions in the design range. In both cases it was found 
that all initial conditions responded acceptably and that 
the parameter settings could not be improved. 
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The perturbation step size and initial parameter 

values affect the cost and final parameter values found by 

[9] 

pattern search as noted by Hooke and Jeeves. in the 

two segment design, costs were found to vary between .3163 
and .0907 depending upon the step size. However, it was 
found that if the costs for different step sizes were the 
same, the parameter settings of the pwl surface selected 
by the search also agreed. This reinforces the assumption 
that the cost surface is a smooth function of the parame- 
ters, To insure that the best controller design results, 
several step sizes and initial parameter settings should 
be tried if the pattern search is used, computer times 
using the digital model given in Appendix B averaged nine 
minutes for the design of the two-segment controller with 
the IBM 360/67 computer. The three-segment design averaged 
13 minutes. Since computer time is required only during 
the design of the controller, these averages seem a reason- 
able price to pay. 

5 , 2 l/s(s+a) Design Example 

The last example showed that the proposed design pro- 
cedure can be used to design a pwl controller that provides 
acceptable performance for second order systems. As a se- 
cond example, the l/s(s+a) plant was chosen. This plant is 

2 

better behaved than the 1/s plant since it has a pole at 

s = -a that results in a term of the form exp (-at) in the 

time response. This type of response should make the plant 

2 

easier to control than the 1/s plant. 
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The state equations for this plant are 



x-^t) = x 2 (t) 

(5.3) 

x 2 (t) = -ax 2 (t) + u a > 0 

The discrete difference equations are found to be 

x^[(K+l)T] = x^ (KT) + (1/a-l/a exp (-aT) ) x 2 (KT) 

( 5.4) + ( -1/ a 2 +T/ a+exp ( -aT) /a 2 ) U (KT) 

x 2 [(K+l)T] = exp ( -aT) x 2 (KT) + (1/ a+exp ( -aT) /a) U (KT) 

The initial conditions were chosen to lie along the x^ 
axis with the limit at x^ = 15. For this example a value 
of a = 1 was used. 

The optimal response times and the set of initial con- 
ditions were generated by running the plant backward in 
time, switching the control once, and recording the time 
and x^ coordinate when the trajectory intersected the x^ 
axis. A word of caution is in order at this point if op- 
timal response times and initial conditions are to be ge- 
nerated in this manner. For this plant a limit line oc- 
curs in the state space at x 2 = -1/a in the fourth qua- 
drant and at x 2 = 1/a in the second quadrant. This means 
that trajectories starting to the right of the optimal 
switching surface and above the limit line will never go 
below x 2 = - 1/a before reaching the origin. Care must be 
taken to insure that switching of the backward time tra- 
jectories does not take place below the limit line if it 
is desired to generate a set of initial conditions along 
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the x^ axis. 

After obtaining the optimal response times and ini- 
tial conditions, the design process begins by selecting an 
initial value for the variable parameter of a one-segment 
pwl switching surface. The second parameter is fixed by 
the range of initial conditions. For this example P(2)=16 
was selected. Minimization of the cost index using the 
pattern search was accomplished with the results recorded 
in figure 18. 





Initial 


Final 


Cost 


.2098 


.00645 


P(l) 


1 

CO 

o 

• 

o 


-55.2 


P(2) 


16.0 


16.0 



Figure 18. l/s(s+a) One-Segment PWL Controller 
The optimal switching surface for this plant is very nearly 




Figure 19. Optimal Switching Surface for l/s(s+a) 
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The linearity of the optimal surface allows the one-seg- 
ment pwl surface to provide control that is very close to 
the optimal. The maximum percentage deviation from opti- 
mal response time for the set of initial conditions is 
shown in the table to be .645%. As in the last example 
two other sets of initial conditions in the design range 
were tested with a pwl controller with the parameter set- 
tings of figure 18 and no worse deviation occurred than 
that found upon completion of the design. 

Since trajectories for initial conditions along the 
x^ axis cannot pass below the limit line, they approach 
the switching line as shown in figure 19. Trajectories 
from initial conditions beyond x^ = 3.8 reach the switch- 
ing line very close to its intersection with the limit 
line. The design procedure can minimize the cost index 
for any number of segments by passing the first segment 
through this point so that very close to optimal control 
results as it did in the one-segment case. A second pwl 
segment was added to the pwl switching surface to see if 
the above was true or if improvement in the design would 
result. The optimization procedure adjusted the first seg- 
ment so that it did pass through the intersection and a 
cost identical to that obtained for the one-segment design 
resulted. If the first segment were extended the same 
parameter values as listed in table IV would result. After 
the first segment is extended beyond the intersection, the 
trajectories no longer intersect the second segment and no 
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change in the initial parameter settings is made. Since 
no improvement is obtained by adding the second pwl seg- 
ment to the controller the design is completed with one- 
segment. It is to be noted, however, that this probably 
would not be the case for initial conditions located in 
other regions of the state space. The procedure could be 
used to design an acceptable controller for sets of ini- 
tial conditions in other regions of the state space if the 
optimal response times were computed. 

5 . 3 Comparison of Design Methods . 

In this section the two-segment pwl controller des- 
igned in section 5.1 will be compared with controllers 

[2] 

designed using Smith's least squares, fixed-breakpoint 

method. For the first the x^ breakpoints were selected by 
equally dividing the range of interest along the coordi- 
nate axis as specified by Smith. This resulted in one 
breakpoint at x^ = 0 and 9.5. The least squares fit was 
accomplished to determine the slopes of the segments. 
Smith's method with equally spaced breakpoints gives the 
following parameter values when converted to the notation 
of this paper. 



Method 


Proposed 


Smith 


P(l) 


-.9812 


I 

4^ 

0 

O 

<1 


P(2) 


.4187 


9.5 


P ( 3 ) 


-4.572 


-4.917 


P(4) 


10.0 


19.0 
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The pwl switching surface of section 5.1 and that designed 




Figure 20. Comparison of Switching Surfaces. 



A second controller was designed for comparison using 
the least squares method, but the x^ breakpoint used was 
the one selected by the proposed method for the best two- 
segment controller given in figure 15. The parameters re- 
sulting from the fit are given below. 



Method 


Proposed 


Smith 


P(l) 


-.9812 


-.9959 


P(2) 


.4187 


.4187 


P (3) 


-4.572 


-4.1616 


P (4) 


10.0 


10.0 



The controllers were compared on the basis of maximum 
normalized deviation time and the sum of pwl response 
times for a specified set of initial conditions. The re- 
sults are listed in figure 21. 
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Method 


max(t-t*)/t* 


Sti 


Proposed 


.092 


71.460 


Smith equal 
spacing 


1.716 


119.02 


Smith best 
breakpoint 


.115 


73.594 


Optimal 


-- 


66.8165 



Figure 21. Comparison of Controller Designs 

The values in the table show the proposed design proce- 
dure is significantly better than Smith's method when 
evaluated using the cost index of this paper and the sum- 
mation of response times. 
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6 . SUMMARY 



6.1 Discussion of Results 

The problem of designing an easily-realized, close-to- 
optimal controller was studied. It was specified that the 
control law be realized as a piecewise-linear combination 
of the system state variables. With the controller in this 
form, the problem is to select the parameters that define 
the pwl switching surface which provides the best subopti- 
mal performance. 

The viewpoint was taken that deviations from optimal 
performance would be accepted if savings in terms of cost 
and complexity could be achieved. This approach led to 
the concept of acceptable performance of the controller. 

The properties of various cost indices were investigated, 
and the decision was made that a response-time index 
should be selected rather than a heuristic one such as 
the least squares polynomial fit. The problems associated 
with summation of response-time indices were explored, and 
no solution was readily apparent. The worst-case indices 
were then evaluated, and it was determined that if the 
min-max point can be found, a controller can be designed 
that will provide acceptable performance for the region of 
interest in the state space. 

A design procedure that provides acceptable control 
while requiring the minimum number of pwl segments was pro- 
posed. Performance of the method for second-order systems 



55 



was demonstrated by example and a comparison of perform- 

[ 2 ] 

ance was made with Smith's least squares method. The 
results of the comparison showed that the design method 
of this paper produced a significantly better controller. 
The design method of section 4.1 resulted in controllers 
that allowed only slight deviations from optimal perform- 
ance. Additionally the controllers are simple to imple- 
ment since they use the minimum number of pwl segments. 

6.2 Areas for Further Study 

Although this study has shown the merits of using 
the worst-case cost index, many areas of the suboptimal 
switching problem are open to further study. Perhaps the 
most important addition to this work would be its exten- 
sion to third and higher order systems. As noted previous- 
ly, all system simulations were accomplished using a purely 
digital model. The use of a hybrid model should be invest- 
igated since a considerable saving in computer time requir- 
ed for the design could be realized. The numerous integra- 
tions necessary to generate the pwl response times are 
more suitable to analog simulation while the logic capabi- 
lities of digital computation are necessary for parameter 
optimization. 

The pattern search as used with this design method 
should be investigated to see if it can be modified to re- 
move its dependence upon parameter step size and starting 
point of the search. In the example studies of section 
5.1 and 5.2, it was determined that certain combinations 
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of step size and initial parameter settings caused the 
search to terminate prior to reaching the minimum of the 
cost surface. It is desired that the search reach the 
min-max point under all conditions. Perhaps a new search 
technique especially suited for finding the min-max solu- 
tion regardless of the starting conditions can be developed. 

The feasibility of searching the range of initial con- 
ditions in an effort to locate the true min-max should be 
investigated. It is possible that a point exists in the 
range of initial conditions that results in worse deviation 
than that found for the finite set used. In the examples 
of section 5 other sets of initial conditions in the de- 
sign range were used to check for possible worse points. 
This check showed no worse points, however, it did not 
prove that none exist. 
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APPENDIX A 



Pattern Search for Cost Index Minimization 

[ 9 ] 

The pattern search technique of Hooke and Jeeves is 
a "direct search" in that sequential trial solutions are 
compared to the previous "best" solution to determine the 
next trial solution. The search minimizes a function of 
several variables, S(p), by determining the sequence of 
values of p that provide improvement in the function value. 

Two types of moves are made in the search. Explorato- 
ry moves are made about a selected base point by changing 
each variable by a selected step size. Each exploratory 
move is successful if S (p) decreases. The exploratory 
moves provide information about the behavior of the func- 
tion being searched. The successful exploratory moves are 
formed into a pattern indicating the direction of a move 
that will probably be successful in reducing the value of 
the function. The sequence of exploratory moves and the 
establishment of a pattern is shown in figure A-l. 




Figure A-l. Exploration and Pattern Establishment. 
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Starting at the first base point in the figure, point 
b o »p(l) is varied by and S(p) is evaluated. If the 

value of the function is reduced the move is successful 
and point a^ would become the new base point for further 
exploration. For the case shown, the -A^ move is not suc- 
cessful so + A^ tried and found to be successful. Point 

a£ now becomes the base point for variation of p(2). A 
step of +^2 is now made in p(2) and found to be success- 
ful. Point b 2 is then designated the new base point. 

Rather than repeating the sequence of exploratory moves 
around the new base point, a pattern move is made that re- 
peats the combined moves from the previous base point b Q . 
That is, all variables are again changed by the amount 
that was necessary to reach the present base point. In 
figure A-l the pattern move is made from b^ to c. If the 
move is successful, a new set of explorations is made, a 
new base point is found, and the pattern move is repeated. 
This process tends to accelerate the search as shown in 
figure A-2. 
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Start 




Figure A 3, Pattern Search Flow Diagram 



61 



If the pattern move is unsuccessful, the pattern is 
destroyed and exploration is made about the last base 
point in order to develop a new pattern. It may be ne- 
cessary to reduce the exploration step size in order to 
reestablish a good pattern. After finding a new direc- 
tion to move, the pattern will grow in size as described 
above . 

When the search has reached the region of the minimum 
of S(p), the step size is decreased in order to continue 
improvement. When the step size has reached prespecified 
minimum size, the search will terminate, and the variables 
have the values for which the function reaches its mini- 
mum. A flow diagram for the pattern search is shown in 
figure A-3. 



62 



EXTERNAL PI 

COMMON X( 5) tXI ( 5» 30) t XP < 5 ) , THAT < 30 ) ,TSTAR( 30) ,COST< 30) ,DFV( 3C 
DEVN ( 30 ) ,PS (15) . P < 1 5 ) , DEL ,CR I T , CR , N , NSEG , N I C , NP 
DIMENSION DN (15) 



APPENDIX B 



Computer Programs 



1/s Two-Segment Example 
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